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(57) Abstract: A method and apparatus are disclosed for recommending television programming using decision trees. Inductive 
principles are utilized to identify a set of recommended programs that may be of interest to a particular viewer, based on past viewing 
behavior. A user's viewing history (130) is monitored and the shows that are actually watched by a user (positive examples) and 
the shows that are not watched by the user (negative examples) are analyzed For each positive and negative program example (i.e., 
programs watched and not watched), a number of program attributes are classified in the user profile. The various attributes are 
then positioned in a hierarchical decision tree (200) based on a ranking of the entropy of each attribute. Each node and sub-node in 
the decision tree corresponds to a given attribute from the user profile. Each leaf node in the decision tree corresponds to either a 
positive or negative recommendation for a program mounted at the corresponding leaf node. The decision tree is (200) built using a 
decision tree process (300) that implements a "top-down divide and conquer" approach. The decision tree can thereafter be applied 
to an electronic program guide (140) to make program recommendations. 
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Method and apparatus for recommending television programming using decision trees . ^ 



The present invention relates to a method and apparatus for recommending 
television programming, and more particularly, to a method and apparatus for recommending 
television programming through the use of decision trees. 



As the number of channels available to television viewers has increased, along : 
with the diversity of the programming content available on such channels, it has become 
increasingly challenging for television viewers to identify television programs of interest. 
Historically, television viewers identified television programs of interest by analyzing printed 
television program guides. Typically, such printed television program guides contained grids ; 
listing the available television programs by time and date, channel and title. As the number of 
television programs has increased, the ability to effectively identify desirable television 
programs using such printed guides has become impractical. 

More recently, television program guides have become available in an 
electronic format, often referred to as electronic program guides (EPGs). Like printed 
television program guides, EPGs contain grids listing the available television programs by 
time and date, channel and title. An EPG, however, allows television viewers to sort or 
search the available television programs in accordance with personalized preferences. In 
addition, EPGs allow for on-screen presentation of the available television programs. 

While EPGs allow viewers to identify desirable programs more efficiently 
than conventional printed guides, they suffer from a number of limitations, which if 
overcome, could further enhance the ability of viewers to identify desirable programs. For 
example, many viewers have a particular preference towards, or bias against, certain 
categories of programming, such as action-based programs or sports programming. Thus, the 
viewer preferences can be applied to the EPG to obtain a set of recommended programs that 
may be of interest to a particular viewer. 

Thus, a number of tools have been proposed or suggested for recommending 
television programming. The Tivo™ system, for example, commercially available from Tivo, 
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Inc., of Sunnyvale, California, allows viewers to rate shows using a "Thumbs Up and 
Thumbs Down" feature and thereby indicate programs that the viewer likes and dislikes, 
respectively. Thereafter, the TiVo receiver matches the recorded viewer preferences with 
received program data, such as an EPG, to make recommendations tailored to each viewer. 

5 Thus, such tools for recommending television programming provide selections 

of programs that a viewer might like, based on the viewer's past viewing history as well as a 
profile containing viewer preferences. In fact, such tools for recommending television 
programming generally require explicit profile information from the user. Viewers, however, 
may not take the time required to sufficiently detail their viewing preferences in a user 

0 profile. A need therefore exists for a method and apparatus for recommending television 
programming based on the viewer's past viewing history. A further need exists for a method 
and apparatus for recommending television programming that does not require any explicit 
profile information from the viewer. 



Generally, a method and apparatus are disclosed for recommending television 
programming using decision trees. According to one aspect of the invention, inductive 
principles are utilized to identify a set of recommended programs that may be of interest to a 
particular viewer, based on the past viewing history of a user. 

The present invention monitors a user's viewing history and analyzes the 
shows that are actually watched by a user (positive examples) and the shows that are not 
watched by the user (negative examples). For each positive and negative program example 
(i.e., programs watched and not watched), a number of program attributes are classified in the 
user profile, such as the time, date, duration, channel, rating, title and genre of a given 
program. The various attributes are then positioned in the hierarchical decision tree based on 
a ranking of the entropy of each attribute. Each node and sub-node in the decision tree 
corresponds to a given attribute from the user profile. Each leaf node in the decision tree 
corresponds to either a positive or negative recommendation for a program mounted at the 
corresponding leaf node. The decision tree attempts to cover as many positive examples as 
possible but none of the negative examples. 

The television programming recommender of the present invention processes a 
user profile, if available, and the viewing history of a user to generate a decision tree. The 
decision tree is built using a decision tree process that implements a "top-down divide and 
conquer" approach. The decision tree can thereafter be applied to an electronic program guide 
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to make program recommendations. The program recommendations may be, for example, a 
set of recommended programs that may be of interest to a particular viewer. 

A more complete understanding of the present invention, as well as further 
features and advantages of the present invention, will be obtained by reference to the 
5 following detailed description and drawings. 



Fig. 1 illustrates a television programming recommender in accordance with 
the present invention; 

10 Fig. 2 illustrates a hierarchical decision tree that positions the various 

attributes of television programs in the tree based on a ranking of the entropy of each 
attribute; 

Fig. 3 is a flow chart describing an exemplary decision tree process 
embodying principles of the present invention; 
15 Fig. 4 is a flow chart describing an exemplary decision tree building 

subroutine embodying principles of the present invention; 

Fig. 5 is a sample table illustrating the creation of a decision tree in accordance 
with well-known techniques; and 

Fig. 6 illustrates the resulting decision tree corresponding to the example of 

20 Fig. 5. 



Fig. 1 illustrates a television programming recommender 100 in accordance 
with the present invention. The disclosed television programming recommender 100 utilizes 

25 inductive principles to identify a set of recommended programs that may be of interest to a 
particular viewer. The present invention monitors a user's viewing history and analyzes the 
shows that are actually watched by a user (positive examples) and the shows that are not 
watched by the user (negative examples). Thereafter, the present invention discriminates 
between the positive and negative examples by building a decision tree that attempts to cover 

30 as many positive examples as possible but none of the negative examples. 

According to another feature of the present invention, the television 
programming recommender 100 makes recommendations without requiring any explicit 
profile information from the user. When available, explicit user profile information augments 
the recommendations produced by the television programming recommender 100. The 
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television programming recommender 100 typically learns by observing the user's viewing 
habits over time and generalizing the viewing habits to build a user profile that attempts to 
cover as many positive examples as possible but none of the negative examples. 

As shown in Fig. 1, the television programming recommender 100 processes a 
5 user profile 120, if available, and a user's viewing history 130 to generate a decision tree 200. 
It is noted that the results of processing the user viewing history 130 can be stored in the form 
of updates to the user profile 120. The decision tree 200 may be applied to an electronic 
program guide 140 to make program recommendations. The program recommendations may 
be, for example, a set of recommended programs that may be of interest to a particular 
10 viewer. 

As shown in Fig. 1, the television programming recommender 100 contains a 
decision tree process 300, discussed further below in conjunction with Fig. 3, that generates a 
decision tree for a given user, by invoking a decision tree building subroutine 400, discussed 
further below in conjunction with Fig. 4. The television programming recommender 100 may 
15 be embodied as any computing device, such as a personal computer or workstation, that 

contains a processor, such as a central processing unit (CPU), and memory, such as RAM and 
ROM. 

For each positive and negative program example (i.e:, programs watched and 
not watched), a number of well-known attributes are classified in the user profile, such as the 

20 time, date, duration, channel, rating, title and genre of a given program. As shown in Fig. 2, 1 
the various attributes are positioned in the hierarchical decision tree 200 based on a ranking 1 
of the entropy of each attribute. The illustrative decision tree 200 includes a root node 205 
and a number of sub-nodes, such as sub-nodes 210, 220, 245, 250, 260, 265 and 270. Each 
node and sub-node in the decision tree 200 corresponds to a given attribute from the user 

25 profile. Each leaf node in the decision tree 200, such as the leaf nodes 225, 230, 235, 240, 
and 281-293, corresponds to either a positive or negative recommendation for a program 
mounted at the corresponding leaf node. 

For example, if a given program in the training data has a duration of more 
than 45 minutes, but less than or equal to 65 minutes, and is a western (genre), the program 

30 will be classified under leaf node 235 as a positive example. Thereafter, if a given program in 
the test data has values meeting this criteria for these attributes the program will be a 
recommended program. 

The decision tree 200 is built using a decision tree process 300, shown in FIG. 
3, that implements a "top-down divide and conquer" approach. The decision tree 200 can 
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thereafter be converted to rules. The decision tree rules allow the introspective analysis of the 
behavior of the present invention. The decision tree techniques of the present invention are 
based on the well-established theory of Ross Quinlan, discussed, for example, in C4.5: 
Programs for Machine Learning, Morgan Kaufinann Publishers, Palo Alto, CA 1990, 
5 incorporated by reference herein. In addition, the decision tree is easily calculated, can be 
used in real-time and can be extended to any number of classes. 
DECISION TREE PRINCIPLES 

Decision Trees are based on the well-established theory of concept learning 
developed in the late 1950s by Hunt et. aL See, for example, Hunt et al., Experiments in 

10 Induction, Academic Press, New York (1966). It was further extended and made popular by 
Breiman et. al. Breiman et al., Classification and Regression Trees, Belmont, CA 
(Wadsworth, 1984); Quinlan J. R., Learning Efficient Classification Procedures and their 
Application to Chess End Games, Michalski R. S., Carbonell J. G. and Mitchell T. M. (Eds.), 
in Machine Learning: An Artificial Approach, Vol. 1, Morgan Kaufinann Publishers Inc., 

15 Palo Alto, California (1983); Quinlan J. R., Probabilistic Decision Trees, Kodratoff Y. and 
Michalski R. S. (Eds.), in Machine Learning: An Artificial Approach, Vol. 3, Morgan 
Kaufinann Publishers Inc., Palo Alto, California, (1990); and Quinlan J. R., C4.5: Programs 
for Machine Learning, Morgan Kaufinann Publishers, Sam Mateo, CA (1993). 
The basic method for constructing a decision tree is as follows: Let T be a set of training 

20 cases and let the classes be denoted as {Ci, C2, . . Ck}. The following three possibilities 
exist: 

T contains one or more cases, all belonging to a single class Cj : 
The decision tree for T is a leaf identifying class Cj. 
T contains no cases : 

25 The decision tree is again a leaf, but the class to be associated with the leaf 

must be determined from information other than T. For example, the leaf can be chosen with 
the aid of background knowledge about the domain. 

T contains cases that belong to a mixture of classes : 

In such a case, the approach is to refine T into subsets of cases that seem to be 
30 heading towards, single class collection of cases. A test is so chosen, based on a attribute, that 
has one or more mutually exclusive outcomes {Oi, 0 2 , O n }. T is partitioned into subsets 
Ti, T 2 , . . T n , where Tj contains all the cases in T that have outcome Oi of the chosen 
outcome. The decision tree for T consists of a decision node identifying the test, and one 
branch for each possible outcome. The same tree-building approach is applied recursively to 
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each subset of training cases, such that the ith branch leads to the decision tree constructed 
from the subset Tj of training cases. 

The tree building process depends on the choice of an appropriate test. Any 
test that divides T in a non trivial way, so that at least two of the subsets {Tj} are not empty, 
5 will eventually result in a partition into single class subsets, even if all or most of them 
contain a single training case. However, the objective of the present invention is not to 
merely build a tree from any partition but to build a tree that reveals the structure of the data 
set and has predictive power for unseen cases. The test is normally chosen based on gain 
criterion, based on information theory and explained below. 

10 Suppose that we have some test with n possible outcomes that partitions the 

set T of training cases into subsets T|, T 2 . T n . If this test is to be evaluated without 
exploring subsequent divisions of the Tj's, the only information available to us is the 
distribution of classes in T and its subsets. Let S be any set of cases and let, freq(Cj, S) denote 
the number of cases in S that belong to class Q and | S | be the number of cases in set S. The 

15 information theory that underpins the criterion for selecting the test is as follows: the 

information conveyed by a message depends on its probability and can be measured in bits as 
minus the logarithm to base 2 of that probability. As an example, if there are eight equally 
probable messages, the information conveyed by any one of them is -log2(l/8) or 3 bits. On 
selecting one case at random from a set S of cases that belongs to some class Cj, then that 

20 message would have a probability of 
freq(C J9 S) 
\ S \ 

and the information the message conveys is 
(freq(c„s)} 
1*1 

In order to find the expected information from such a message pertaining to 
25 class membership, we sum over the classes in proportion to their frequencies in S, giving 



-log. 



bits. 



■r(?\ ^ JMC„S) (freq{c„s)) 



bits. 



On applying to the set of training cases, info(T) measures the average amount 
of information needed to identify the class of a case in T. This quantity is often known as the 
entropy of the set S. When T has been partitioned in accordance with n outcomes of a test X, 
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the expected information can then be found as the weighted sum over the subsets and is given 
by: 

infoAT) = ±^*i»MT,). .. 

The following quantity: 
5 gain{x) = info{T) - info x (T) 

measures the information that is gained by partitioning T in accordance with the test X and is 
often called as the gain criterion. This criterion, then, selects a test to maximize the 
information gain commonly referred to as the mutual information between the text X and the 
class. 

10 Although the gain criterion gives good results, it has a serious deficiency 

namely that of having a strong bias in favor of tests with many outcomes [Quinlan, 1990]. As 
an example, consider a hypothetical medical diagnostic task in which one of the attributes 
contains patient identification. Since every such identification is intended to be unique, \f\Jf : 
partitioning the set of training cases on the values of this attribute will lead to a large number 

15 of subsets, each containing just one case. As all of these one case subsets would contain cases 
of a single class, infox(T) would be 0. Thus the information gain from using this attribute to 
partition the set of training cases is maximal. However, from the point of view of prediction, 
such a division is of not much use. 

The bias inherent in the gain criterion is rectified by normalization wherein the 

20 apparent gain attributable to tests with many outcomes is adjusted. Now consider the 

information content of a message pertaining to a case that indicates not the class to which the 
case belongs, but to the outcome of the test. Analogous to the definition of info(S), we have 

*p/fti^(jf) = -£|^xlog a 



This represents the potential information generated by dividing T into n 
25 subsets, whereas the information gain measures the information relevant to classification that 
arises from the same division. Then, the expression gain ratio(X) = gain(X) / split info(X) 
expresses the proportion of information generated by the split. When the split information is 
small, this ratio is unstable. To avoid this, the gain ratio criterion selects a test to maximize 
the ratio subject to the constraint that the information gain must be at least as great as the 
30 average gain over all tests examined. 
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The description above for the construction of a decision tree was based on the 
assumption that the outcome of a test for any case can be determined. However, in reality 
data* often as missing attribute values. This could be because the value is not relevant to a 
particular case, was not recorded when the data was collected, or could not be deciphered by 
5 the subject responsible for entering the data. Such incompleteness is typical of real-world 
data. We are then left with two choices: either a significant proportion of available data must 
be discarded and some test cases pronounced unclassifiable, or the algorithms must be 
amended to cope with missing attribute values. In most situations, the former is unacceptable 
as it weakens the ability to find patterns. Modification of the criteria for dealing with missing 
0 attribute values can then be realized as follows. 

Let T be the training set and X a test based on some attribute A, and suppose 
that the value of A is known only in a fraction F of the cases in T. info(T) and info x (T) are 
calculated as before, except that only cases with known values of A are taken into account. 
The definition of gain can then be amended to: 
5 gain(X) = probability A is known x (info(T) - info x (T)) 

+ probability A is not known x 0 

= F x (info(T) - infox(T)). 

This definition of gain is nothing but the apparent gain from looking at cases 
with known values of the relevant attribute, multiplied by the fraction of such cases in the 

0 training set. Similarly the definition of split info(X) can also be altered by regarding the cases 
with unknown values as an additional group. If a test has n outcomes, its split information is 
computed as if the test divided the cases into n+1 subsets. Using the modified definitions of 
gain and split info partitioning the training set is achieved in the following way. When a case 
from T with known outcome Oj is assigned to subset Tj, the probability of that case belonging 

5 in subset Tj is 1 and in all other subsets 0. However, when the outcome is not known, only a 
weaker probabilistic statement can be made. If the case has a known outcome, this weight is 
1; if the case has an unknown outcome, the weight is just the probability of outcome Oj at 
that point. Each subset Tj is then a collection of possibly fractional cases so that |Tj| can be re- 
interpreted as the sum of the fractional weights of the cases in the set. It is possible that the 

0 training cases in T might have non-unit weights to start with, since T might be one subset of 
an earlier partition. In general, a case from T with weight w whose outcome is not known is 
assigned to each subset Tj with weight 

w x probability of outcome Oj. 
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The latter probability is estimated as the sum of the weights of cases in T 
known to have outcome Oj, divided by the sum of the weights of the cases in T with known 
outcomes on this test. 

If we assume the classes to be 'shows-watched' and 'shows-not- watched', 
5 then the format of the DT is such that, it has nodes and leaves where nodes correspond to 
some test to be performed and leaves correspond to the two classes. Testing an unknown case 
(show) now involves in parsing the tree to determine as to which class the unknown case 
belongs to. However, if at a particular decision node we encounter a situation wherein the 
relevant attribute value is unknown, so that the outcome of the test cannot be determined, the 
10 system then explores all possible outcomes and combines the resulting classifications. Since 
there can now be multiple paths from the root of a tree or from the subtree to the leaves, the 
classification is then a class distribution rather than a single class. When the class distribution 
for the unseen case has been obtained, the class with the highest probability is assigned as the 
predicted class. 

15 Fig. 3 is a flow chart describing an exemplary decision tree process 300 

embodying principles of the present invention. As shown in FIG. 3, the decision tree process 
300 initially selects a random subset, W, from the training data during step 310. Thereafter, 
the decision tree process 300 executes the decision tree building subroutine 400, discussed 
further below in conjunction with FIG. 4, during step 320 to build a decision tree for the 

20 current window, W. 

Once the decision tree building subroutine 400 has built the decision tree for 
the current window, W, the training set is scanned for exceptions to the decision tree during 
step 330. As previously indicated, the decision tree randomly selects a subset of positive and 
negative examples from the total set of examples given to it and uses the subset to build a 

25 decision tree. Thereafter, the decision tree process 300 applies the generated tree on the 
remaining examples during step 330. If any example gets misclassified, the decision tree 
process 300 adds the misclassified example (exceptions) to the originally generated random 
subset, in the following manner. If exceptions to the decision tree are found during step 330, 
then one or more of the exceptions are inserted into the window, W, during step 340 and 

30 program control repeats from step 320. If no exceptions to the decision tree are found during 
step 330, then program control terminates. This process is continued until no performance 
improvement can be found from one iteration to the next. 

In a further variation, examples are given to the decision tree process 300 
based on an assumption of what the users likes and dislikes, where the user has graded the 
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shows, for example, on a scale of 1 to 5. These grades can be incorporated into the decision 
tree in such a way that some bias is added. Namely, the process 300 adds the misclassified 
example only if the user's grade exceeds a predefined (or user-specified) value, such as 3. In 
other words, the user indicates how important it is for him or her that the system should 
5 recommend shows that he or she likes/dislikes. In this manner, the present invention will be 
more tailored to the user's likes/dislikes. Likewise, there will be some performance 
improvement as the system does not attempt to cover all the examples. 

Fig. 4 is a flow chart describing an exemplary decision tree building 
subroutine 400 embodying principles of the present invention. As shown in FIG. 4, the 
10 decision tree building subroutine 400 initially selects the best attributeduring step 410 that 
minimizes the entropy function, H, as follows: 

//=2-/>(oio g p(/) 

where P(i) is the probability associated with the X th class. Thereafter, the training instances are 
categorized during step 420 into subsets by this attribute. 
15 Finally, the process is repeated recursively during step 430 until each subset 

contains instances of one kind (class) or a predefined statistical criterion is satisfied. Program 
control then returns to the decision tree process 300 (step 330). 
DECISION TREE EXAMPLE 

Fig. 5 is a sample table 500 that illustrates the creation of a decision tree in 
20 accordance with well-known techniques. As shown in FIG. 5, the table 500 contains a 

plurality of records, each associated with different combinations of the attributes size, color 
and surface, as identified in fields 520, 530, 540, respectively. Each record has been 
classified into a given class, as identified in field 510. 

According to the decision tree building subroutine 400, the decision tree is 
25 constructed by first calculating the entropy for each attribute (size, color and surface) during 
step 410, as follows: 

Si K : ff a(-I log I) + i(-2 log i-| log 2] + I(-I 1 „ g i)=0.46 2 



Color: H = ] j -|log|-jlog-J- | + fj -^log^ 



=0.318 
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The attribute "color" is selected during step 420 as the root node 605, since it 
has the minimum entropy. Therefore, the attribute "color" is removed from the attributes and 
the process is repeated during step 430, as follows: 



10 the decision tree can be applied to an electronic program guide 140 to identify a set of 
programs that will likely be of interest to the user. For each program in the electronic 
program guide 140, the decision tree is traversed to classify the program into one of the leaf 
nodes. Based on the assigned leaf node, a given program is either a positive or negative 
recommendation. 

15 It is to be understood that the embodiments and variations shown and 

described herein are merely illustrative of the principles of this invention and that various 
modifications may be implemented by those skilled in the art without departing from the 
scope and spirit of the invention. 




5 




On the second pass through the data, the attribute "size" is selected during step 
420 as the second decision node 610, since it has the minimum entropy. The resulting 
decision tree is shown in Fig. 6. 

Once the decision tree 200 is created in accordance with the present invention, 
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CLAIMS: 



1. A method for obtaining a recommendation (145) for a television program for a 
user, said program having attributes, said method comprising the steps of: 

obtaining a viewing history (130) for said user; 

analyzing positive and negative examples of training programs that are liked by said user; 
5 generating a profile (120) containing a number of attributes for said positive and negative 
examples; 

positioning said attributes in a hierarchical decision tree (200); and determining a 
recommendation (145) for said television program based on a location of said television 
program in said decision tree (200). 

10 

2. A method for obtaining a recommendation (145) for a television program for a 
user, said program having attributes, said method comprising the steps of: 

obtaining examples of programs that are liked and disliked by said user; 
generating a hierarchical decision tree (200) having nodes comprised of said attributes, said 
1 5 hierarchy based on a ranking of the entropy of each of said attributes; and recommending 
said television program based on a location of said television program in said decision tree 
(200). 

3. The method of claim 1 or 2, wherein said profile (120) also includes 
20 information provided by said user. 

4. The method of claim 1, 2 or 3 wherein said recommendation (145) is a 
positive or negative recommendation. 

25 5. The method of any one or more of claims 1 to 4, wherein said positive or 

negative examples are scored by said user. 

6. The method of claim 5, wherein said score is utilized to bias the processing of 

examples that are misclassified in said decision tree (200). 
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7. The method of any one or more of claims 1 to 6, wherein the placement of said 
attributes in said decision tree (200) is based on a ranking of the entropy of each of said 
attributes. 

8. The method of claim 7, wherein said entropy, H, of each of said attributes is 
obtained using the following expression: 

where P(i) is the probability associated with the class. 

9. The method of any one or more of claims 1 to 8, wherein said positioning step 
further comprises the steps of selecting an attribute that minimizes said entropy function, H, 
categorizing said training data into subsets by this attribute; and repeating said method 
recursively until each subset contains instances of one kind or a predefined statistical 
criterion is satisfied. 

10. The method of any one or more of claims 1 to 9, further comprising the step of 
applying said decision tree 200 to additional positive and negative examples to identify a 
misclassified example. 

11. The method of claim 10, wherein said positioning step further comprises the 
step of inserting said misclassified example into said original positive and negative examples 
and repeating said positioning step until a predefined threshold is satisfied. 

12. A system for obtaining a recommendation (145) for a television program for a 
user, said program having attributes, comprising: 

a memory for storing computer readable code; and a processor operatively coupled to said 
memory, said processor configured to: 
obtain a viewing history (130) for said user; 

analyze positive and negative examples of training programs that are liked by said user; 
generate a profile (120) containing a number of attributes for said positive and negative 
examples; 
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position said attributes in a hierarchical decision tree (200), and determine a recommendation 
(145) for said television program based on a location of said television program in said 
decision tree (200). 

5 13. A system for obtaining a recommendation ( 1 45) for a television program for a 

user, said program having attributes, comprising: 

a memory for storing computer readable code; and a processor operatively coupled to said 
memory, said processor configured to: 

obtain examples of programs that are liked and disliked by said user; 
10 generate a hierarchical decision tree (200) having nodes comprised of said attributes, said 
hierarchy based on a ranking of the entropy of each of said attributes; and recommend said 
television program based on a location of said television program in said decision tree (200). 
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